Figure 1 



100 



INSTRUMENT 


101 




Pwr-source/reg 




102 




Electronic 






Interface 






Elements 




103 




Alternative 






Control Signal 






Elements 




104 




Sensed/Excited 






Vibrating 






Elements 




105 




Alternative 






Audio Signal 






Elements 




106 




Video, Lights, 






Special Effect 






Elements 




107 




Program Storage 







CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



1/72 



no 



GENERALIZED INTERFACE 



111 



Incoming Electrical Power 



112 



Outgoing Control Signals 



113 



Incoming Control Signals 



114 



Outgoing Audio Signals 



115 



Incoming Excitation Signals 



116 



Outgoing Video Signals 



117 



Incoming Video Signals 



120 



SIGNAL ROUTING, 
PROCESSING, 
AND SYNTHESIS 

121 



Power Supply(ies) 



122 


123 


Control 


Control 


Signal 


Signal 


Routing 


Processing 



128a 



128b 



Control 




Control 


Signal 




Signal 


Extraction 




Synthesis 


124 


125 



Audio 


Audio 


Signal 


Signal 


Routing 


Processing 


126 


127 


Video 


Video 


Signal 


Signal 


Routing 


Processing 


129a 


129b 



Audio 




Video 


Signal 




Signal 


Synthesis 




Synthesis 



130 

Program Storage 



Figure 2 



110 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

2/72 

120 



GENERALIZED INTERFACE 
111 



Incoming Electrical Power 



112 



Outgoing Control Signals 



113 



Incoming Control Signals 



114 



Outgoing Audio Signals 



115 



Incoming Excitation Signals 



116 



Outgoing Video Signals 



117 



Incoming Video Signals 



SIGNAL ROUTING, PROCESSING, AND SYNTHESIS 
121 130 



Power Supply(ies) Program Storage 




Control 
Signal 
Routing 




Control 
Signal 
Processing 



128b 



Control 
Signal 
Synthesis 



< 129a 



124 t 



Audio 
Signal 
Routing 



Audio 
Signal 
Synthesis 



^ 125 



128a 



126 f 



Control 
Signal 
Extraction 



Audio 
Signal 
Processing 



129b 



Video 
Signal 
Routing 



Video 
Signal 
Synthesis 



^ 127 



Video 
Signal 
Processing 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

Figure 3A 3/72 

) 



304a 304b 




310a 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

4/72 




419 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

5/72 

) 



Figure 5 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

6/72 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

7/72 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 8 



8/72 



802 



I \ 

I I 

I I 

I I 

1 I 



Common 
Address 
Sequencer 



/ \ 



806 



I I 
f I 
I I 



804 



/ \ 



I I 

I I 

I I 

t f 

\ I 



805 



Scan 
+ 

Interpret 



i\ 

~T~P 
I i 
I I 
i I 
i i 



803.1 



801.1 N ^ 800.1y 



Key 
Control 
Muxing 



Keys 
or 

Strumpad 
Switches 



801.n 



800.n 



i r* 
i i 
i i 
i i 



803.n 



■v 



Key 
Control 
Muxing 



■v 



Keys 
or 

Strumpad 
Switches 



Figure 9 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No. : 2738-20 



9/72 



905 



901.1 



902 



Strum-pad ^ 




























■ 




■ 












\ 









V 



Conventional 
MIDI 

Keyboard 
Interface 
Electronics 



900 



90Ln 



note 

event 

msgs 



903 



/ 



Stored Program ] 



Reassign to each 
received note: 

• Potentially new 

channel # 

• Potentially new 
note* 



904 



T 



Jo6 



MIDI 
Routing 



908.1 



+ Channel 
Splits 



.908.2 



^908.M 



907 



SSESS^S&SSS 0 " 0 ELECTR0NIC MUS,CAL 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 10 10/72 



1001.1 1011.1 

1001. n ; lOll.n ; 

1002.1 1012.1 

1002. m J 1012.m > 

or:::} 

■ 
■ 

■ 

1003.1 1013.1 

1003. k ; 1013.k ' 



1050 



1051 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 11 1 1 / 72 



1102b 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 12 12/72 



Null/Contact 
Touchpad 



Interface 
Electronics 



1200 1202 lioi 1204 



MIDI 
Message 
Assignment 



1205 



1203 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 13 13/72 



Pressure Sensor 
Array Touchpad 



I 



-1300 
1302 



Data Aquisition — 1301 



1304 



1308 



1303 Region Define 

— r~ 



1306- 



1307 



1305 



Region Classify 



I 



1310 



1309 



Parameter Derive 



1311 




1312 



1313 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 14 



14/72 



1410 



1400 



1422 




1420 



1423b 



1400 




Figure 15 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



15/72 



1500 

End Finger J 



tip CZ> 1501 
■flat Q 1502 



pressed 



1503 



1504 

Flat Finger - tip 

segment I 

-mid r\ 
segment I 1 

- inner 



segment 



1504a 
1504b 

1504c 



Thumb, 




1505 



Wrist 




1506 



Cuff 



1507 




Palm 



1508 




1513c 



1511 15Ua 1511b 

Whole ( ^ 



1511c 




1512a 



1513b 



1513a 




Figure 16 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



16/72 



1614 1600 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

Figure 17 17/72 




Figure 18 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



18/72 



J 



increasing 1801a 

brightness 




decreasing 1801b 
brightness 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

19/72 



Figure 19 




1901 1902 1903 1904 1905 
1900 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 20 20/72 



2000 



> 



-2011 
-2012 



-2021 2000 

/ 



-2022 




s' N N 2043 

S X 



2041- 



2000 

/ 



-2042 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 21 21/72 




Figure 22 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



22/72 



2201 

vibrating element 



2205 
speaker 



2204 

power amplifier 



2202 

transducer 



f\ru\ 

acoustic 
coupling 

2206 




electrical signal 
2203 



Figure 23 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

23/72 



2201 

vibrating element 



2208 

electromagnetic coil 



2202 ,— , 

transducer 



AAA 

electromagnetic 
coupling 
2209 




coil's power 
amplifier 
2207 



outputs 
2210 



electrical signal 
2203 



Figure 24 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



24/72 



2401 



2400 

/ 



2414a 



2414b 



2411 



2413a 



_> <_ 



\ 



1 



2413b 



2412 




Figure 25 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



25/72 



2201 

vibrating element 



2208 

electromagnetic coil 



2202 1-1 

transducer 



outputs 
2210 



AAA 

electromagnetic 
coupling 

2209 



electrical signal 
2203 




signal processing 
2211 



coil's power 
amplifier 
2207 



Figure 26 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



26/72 



2202 

transducer 



output^ 
2210 



2201.1 

vibrating element 



vibrating element 
2201.n 



2209.1 

coupling 
electromagnetic 

jxrvx 

a 

electromagnetic 
coupling 

2209.n 



2208 

electromagnetic coil 




power 
amplifier 

2207 















electrical signal 





2203 



signal processing 
2211 



Figure 27 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

27/72 



2710 



2711 



<2) <2) <S) <2) <S) <2) <$) <2>- 

TttHHt- 


I I 1 1 1 1 II 1 1 1 
oooooo- 


o o 1 
o o 


i 

i 







2716 
-2715 



2714 
-2713 



-2712 



2720 



2721- 




3| — 2724 
2723 



2722 



2730 



2733 



2731 





1 1 1 1 1 1 1 1 1 1 1- 


2736 




oooooo - 


—2735 








2734 












— 2732 











CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

Figure 28 28 / 72 




2810c 



2812 




2810a 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

Figure 29 29 / 72 

- - ) 



2920 




2922 



2940 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

Figure 30 30 / 72 



3006 




3014 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

Figure 31 31/72 




Figure 32 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

32/72 




Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

Figure 33 33/72 



J 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 1 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

Figure 34 34/72 

) 



3412 



3405 

3404 
3406.1 



(5) (5) (5) (t) (5) (5) (5) (5) 

n t \\ m t- 



T— 3410 



-3411 




406.n 



3407b 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

35/72 




Figure 36 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



36/72 





CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 37 ^7 / 72 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

38/72 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 39 39 / 72 



i ii ii — 1 




3901.n L -"- "- 



3902.n 3903.n 3904.n 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

40/72 



Figure 40 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

41/72 



Figure 41 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 42 42 / 72 



J 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



43/72 



Figure 43 



-4300 



0 



l_4301 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

44/72 



Figure 44 



4451a 




4451a 



4455b 



4455a 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

Figure 45 45/72 




Figure 46 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



46/72 




Control 
Signal 



In 



4625 



4623L 



/ 

4631 4632 



4622 



Control 
^Signal 

\T Out 



4624 



4634 4633 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

Figure 47 47 / 72 



4702 




V . .... . . 

CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 48 48 / 72 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

49/72 




4912 




single channel audio 

multichannel audio out 
+ multichannel audio power 



Q Q ^ video out, video in, video power 
4915 

MIDI out + MIDI power 



Q Q MIDI in + controlled element power 



<$x excitation drive, power 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL ^ 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

Figure 50 50 / 72 



5001.1 

vibrating element 



5002.1 

transducer 



vibrating element 
5001.n 



transducer 
5002.n 



5003 




5004a 

output A 

output B 
5004b 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 51 51/72 



5001.1 

vibrating element 



vibrating element 
5001.n 



5002.1 
transducer 



transducer 
5002.D 



5005.1 



signal processing 



signal processing 



5005.n 



5003 



mixer 



5004a 
-►output A 

►output B 
5004b 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 52 52/72 



5002.1 

5001.1 trans- 
vibrating element ducer 



vibrating element 
5001.n 



trans- 
ducer 
5002.D 



5005.1 



5010 



5003 



5004a 
►output A 




5011 

control 
signals 
output 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 53 53/72 



5002.1 
5001.1 trans- 
vibrating element ducer 



vibrating element trans- 
5001.n ducer 
5002.n 



5006 



input 
mixer 



control signal extraction 
5010 



5007.1 

straight path 



straight path 



5007.m 



5005.1 



signal 
processing 



5005.k 



5003 




output 
mixer 



5004a 
output A 



output B 
5004b 



control signals 
output 
5011 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 54 54 / 72 



5007.1 

straight path 



5003 



5002.1 

trans- 

5001.1 ducer 
vibrating element [1 02] 



vibrating element 
5001.n 



trans- 
ducer 
5002.n 



5008 



switch 
matrix 



control signal extraction 
5010 



straight path 
S007.n * 



signal 
processing 



5005.1 



signal 
processing 



5005.k 




5004a 

output A 



output B 
5004b 



control signals 
output 

5011 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

Figure 55 55 / 72 

J 



5003 



5002.1 
5001.1 trans- 
vibrating element ducer 



vibrating element trans- 
SOOl.n clucer 
5002.n 



input mixer 5006 

and/or 
switch matrix5008 




5004a 

output A 



output B 
5004b 



signal 




signal 


processing 


■ ■ ■ 


processing 


5005.1 




5005.k 



control signal extraction 
5010 



control signals 
output 

5011 



Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

Figure 56 56/72 



5002.1 
5001 1 trans . 
vibrating element ducer 



vibrating element trans- 

SOOl.n ducer 
5002.n 



5003 



input mixer 5006 
and / or 

switch matrix 5008 



output 
mixer 



signal 




signal 


processing 


■ a ■ 


processing 



5005.1 



t i 



5005.k 



f 



I 



5004a 

output A 



output B 
5004b 



logic circuitry 
and/or micro- 
processing 
5009 



control signal extraction 



5010 



control signals 
output 
5011 



Figure 57 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



57/72 



el> 



J 0201 ♦ 

lectromagnetic 



coil 



AM 



*5020.n 



excter 



AAA 



5022. 



5001.1 

vibrating 
element 



5003 



5002.1 

trans- 
ducer 



vibrating trans- 
elemenl du« r 
5001.n 5002.n 

5021.1 



signal 
processing 



signal 
processing 



5022.n 5021.n 




input mixer 

5006 
or 

switch matrix 
5008 



mixer 



signal 

processing ■ • ■ processing 



HV3 

signal 



5004a 
utput A 



- output B 
5004b 



500^.1 



5005.k 



4. 



f 



logic circuitry 
and/or micro- 
processing 

5009 



control signal extraction 
5010 



control sianals 
output 
5011 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

Figure 58 58/72 




Figure 59 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



59/72 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 60 



60/72 



6011 



group 

pickup 

signal 

6001 



distortion 



6004 
L fc. 



6012 



6020 



Spatializer 
effect 



6013 



compression 



6005 



6014 



Spatializer 
effect 



6001 



individual bass 
string 
• pickup 
signal 

6002 



individual high 
string 
pickup 
signal 

6003 



6016 



pitchshift 



6006 



emphasis 
effect 



6018 6007 



6015 



Spatializer 
effect 



6017 



Spatializer 
effect 



6019 



Spatializer 
effect 



output 
mixing 



6021a 

right 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

61/72 

Figure 61 

OUT 






Figure 62 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

62/72 



IN 1 



6201a 



6203 



6203 



6203 



IN 2 



6201b 




6203 



X 



6204 



octave 




octave 


drop 




drop 



6203 



6204 



Multi 
channel 
Mixer 



6206a 

left „„ 



right ~ 
6206b 



6207.1 



6207.n 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No. : 2738-20 

63/72 



Figure 63 



Sequencer 
Control 
Program 



6331 



Sequences 



Audio 

Control 

Program 



6332 



Signal 
Extraction 

Control 
Program 



6333 



Synth 
Control 
Program 



6334 



Strumpads 
♦Keyboard 
Map 
Control 
Program 



6335 



Video 
Control 
Program 



6336 



6341 



it I i 



Audio 
Mixing + 
Routing 

6342 



Audio 
Signal 
Processing 

6343 



Control 
Signal 
Extraction 

6344 



Audio 
Synthesis 

6345 



ii 



Input Control Signals 



6300.1 



6300.n 





,6310 


6301 


Configuration 




Program 






Master 


J>320 




Program 






Lighting 
Control 
Program 



6337 



Video 
Routing 

6346 



Video 
Signal 
Processing 

6347,- 



Lighting 
6348 



Control 
Routing 

and 

Control 
Signal 
Processing 



6302.1 



\ 

6302.m 



T T 

Output Control Signals 
(to all units shown) 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 64 54 j J2 



6400 64rt i 

vibrating M »\ ns _ 



element 



ducer 



6402.1 

bandpass 
filter 



6403.1 


amplitude 




follower 





bandpass 




amplitude 


filter 




follower 



6402.h 



6403.h 



6404 

parameter 
mapping 



control 
• signals 
output 
6405 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL ^ 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

Figure 65 65/72 



6400 

vibrating 
element 



6402.1 



6403.1 



6401 

trans- 
ducer 




bandpass 
filter 




amplitude 
follower ] 










■ 




■ 










■ 
■ 




■ 
■ 










bandpass 
filter 




amplitude 
follower 










6402.h 




6403.h 





6406 

any combining 
or processing 



6404 

parameter 
mapping 



control, 
signals 
output 

6405 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 66 66 / 72 



J 



6400 M01 

vibrating trans- 
element ducer 



£ 



pitch 
detector 



6407 



6402.1 




6403.1 


bandpass 
filter 




amplitude 
follower 



bandpass 
filter 



6402.h> 



model based overtone 
series calculation 



amplitude 
follower 



6403.h 



6406 

any combining 
or processing 



6404 

parameter 
mapping 



control 

signals 

output 

6405 



6408 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



67/72 



Figure 67 



6701.1.1 




i r\ , 1 1 



~\r\ n — E3k , a i 



ark n — 




LFO N Data Vector 



6701.1.N 
6701.M.1 




6700.1 
Prg 1 data 



6702.M 




r r\e~\ ^ — jck — . 



■ r r — — . t r 



LFO N Data Vector 



6701.M.N 




6700.M 
Prg M data 



program select- 
6703 



6704 



(default value associated with with presets) 
—, . 6731 



global amp + offset math 



- 1 . . .1 .. 1 _ 1 


time slewing math 


Jo - ■ • \ r ™ 1 , r . ,1 . .. 1 . «• 1 . 


M p n i i 1 

L Source Select 


pO cat L_ 

Freq/Phase 


waveform 


amp scaling 


rr , 1 

offset 


6732 



LFO 
Engine 



6711 



control signals 



6712 

672i 



6713 



2v 



i 



6714 6715 



(overides default value associated with with selected programs) 



system i 

clock ,L 

6741 f 

to other — \- 
cntr selecters 1 
6742 I 

from other-^. 
counters • ^ 

6743.1 
6743.N I 



6751 



6752 



clock divider 


mod 128 counter] 


1 \ 


6753 




counter select 


mod 128 adder 


phase offset 


6754 


6755 



6750 



6756 



6757 



6758 



select 


waveform table 


amp scaling 


offset 



"673T 



time slewing math program parameter table 



6730 



global amp + offset math 
6731 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 68 68 / 72 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 ; 

69 / 72 

Figure 69 



.6900 
.6902 



^6907 



6905 



6904. 



6903 



6906 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 



Figure 70 



70/72 




7012 7023 



7013 



7027- 




7031 



7032 




7033 



7034 



CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO 

Inventor: Lester F. Ludwig 
Docket No.: 2738-20 

Figure 71 71/72 



7102 




CONTROLLING AND ENHANCING ELECTRONIC MUSICAL 
INSTRUMENTS WITH VIDEO ' ^ 

Inventor: '=5 *ii Lester F. Ludwig 
Docket No.: 2738-20 



Figure 72 



72/72 



Q 



7201 




7200 

























7202 



